Mingqm SUN ™ed. June a f, ^ 

Attorney Docket: 20002/1 6 1 36X2 Serial No. : — _ 

"Methods and Apparatus to Prefetch Memory Objects" 
FIGS. 1-2 Page 1 of 17 







CD 




CO 
CO 



co 



a: 

LU 
X 
LU CO 



CO 



3 

o 
p 

CO 




o 

I- Z LU 

y cd o 

> CO z . 

> CO 
< 



MingqiuSUN rirea. 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 3 Page 2 of 17 




PS3 



PS4 = 



r 



40 



STATE 1 



r 



STATE 2 



r 



40 



40 



STATE 1 



r 



40 



STATE 3 



r 



STATE 4 



40 



40 



STATE 2 



40 



PSX = STATE N 



FIG. 3 



Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIGS. 4, 6 Page 3 of 17 



26 — \ 


TRACE DATA 


B 









36 



EXPONENTIAL 
DECAY 
FUNCTION 



32 




FIG. 4 



o 
1 

0 

1 
1 

0 
0 

1 

0 

1 
1 
1 

0 



~1 



48 



50 



54 



STATE 
TRANSITION 
MONITOR 



ENTROPY 
CALCULATOR 



EVENT 
PREDICTOR 




STATE ARRAY 



FIG. 6 



Attorney Docket: 20002/1 6 1 36X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 5 Page 4 of 17 



STATE SIGNATURE: 


0101100101110 j 


AGE: 


X 


USAGE FREQUENCY: 


Y 


ENTROPY: 


Z 




QTATC- 
OlAI t. 


A 
r\ 


OCCURRENCE 
TIMES: 


00:00:00; 
00:05:13 


PRO BAB I LI I Y: 


0.63 


STATE: 


c 


OCCURRENCE 

-pi k a i— o • 

TIMEo. 


00:02:04; 


PROBABILITY: 


0.12 


CTATC' 
O !M 1 C 




OCCURRENCE 
TIMES: 


00:00:13; 
00:02:43 


PROBABILITY: 


0.08 


STATE: 


G 


OCCURRENCE 
TIMES: 


00:08:06; 
00:09:18 


PROBABILITY: 


0.05 


STATE: 


L 


OCCURRENCE 
TIMES: 


00:10:03 


PROBABILITY: 




STATE: 


M 


OCCURRENCE 
TIMES: 


00:07:53 


PROBABILITY: 


0.02 






































STATE: 


V 


OCCURRENCE 
TIMES. 


00:13:31; 
00:15:37 


PROBABILITY: 


0.01 



FIG. 5 



Mingqiu SUN ruea. June z a, ituvo 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 7 Page 5 of 17 




MingqiuSUN rirca. jotc^,^ 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 8 Page 6 of 17 



FIG. 8 



C Enter ) 



100 



EXECUTE TARGET 
PROGRAM 



END ) 



YES 



END? 



NO 




106 



YES 



RECORD TRACE 




f 



TRACE PROCESSING 
THREAD EXECUTING? 



102 



104 



1 


NO 

i 


START TRACE 
PROCESSING THREAD 



108 



MingqiubUN ruca. 

Attorney Docket: 20002/16136X2 Serial No.: _ 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 9 A Page 7 of 17 



( Enter ) 





f 


COLLECT SET OF 
ENTRIES FROM TRACE 


► 





120 



122 



WEIGHT ENTRIES 



CREATE POSSIBLE 
STATE SIGNATURE 




128 



FIRST POSSIBLE STATE 
SIGNATURE? 



126 
NO 



YES 



CURRENT STATE SIGNATURE = 
POSSIBLE STATE SIGNATURE 



1 



130 



CREATE STATE DATA 
STRUCTURE 




132-^ i 




M 

r 




DROP OLDEST ENTR(IES), 
ADD NEW ENTR(IES) 









FIG. 9A 



Mingqiu SUIN mea. juncii,4WJ 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 9B Page 8 of 17 




CALCULATE DIFFERENCE BETWEEN CURRENT 
STATE SIGNATURE AND CURRENT POSSIBLE 
STATE SIGNATURE 



SIGNATURE DIFFERENCE > 
THRESHOLD? 



YES 



CURRENT STATE SIGNATURE = 
POSSIBLE STATE SIGNATURE 







IS CURRENT STATE 
SIGNATURE NEW? 



YES 



CREATE STATE DATA 
STRUCTURE 



134 





NO 



UPDATE LAST STATE'S 
DATA STRUCTURE 



I 



YES 



DROP STALEST STATE 
DATA STRUCTURE 



144 



146 



SPACE CONSTRAINT? 

I 



150 



-► 




FIG. 9B 



MingqiU 5UIN rmsa. - # , 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 9C Page 9 of 17 



NO 




1 


f x~ 




UPDATE LAST STATE'S 
DATA STRUCTURE 






f /~~ 




CALCULATE ENTROPY 
OF CURRENT STATE 






f /~ 




IDENTIFY NEXT 
PROBABLE STATE(S) 






f , 



160 



162 



164 



168 



ENTROPY SPIKE IDENTIFIED? 



YES 



170 



END OF LAST 
TRANSACTION 




FIG. 9C 



Mingqiu £>un — '» 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 10 Page 10 of 17 






& 


z 


o 


< 


EM' 




2 




o 



UJ 111 



i- < 

CO 



MingqiU OUIN rnca. junt t,f y £wj 

Attorney Docket: 20002/1 6 1 36X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 11 Page 11 of 17 



STATE SIGNATURE: 


0101100101110 


AGE: 


X 


USAGE FREQUENCY: 


Y 


ENTROPY: 


Z 




QTATF- 


A 


OCCURRENCE 
TIMES: 


00:00:00; 
00:05:13 


PROBABILI I Y: 


0.63 


STATE: 


c 


OCCURRENCE 

1 IMto. 


00:02:04; 


PROBABILITY: 


0.12 


O In 1 C_. 


P 

l_ 


OCCURRENCE 
TIMES: 


00:00:13; 
00:02:43 


PROBABILITY: 


0.08 


STATE 


G 


OCCURRENCE 
TIMES: 


00:08:06; 
00:09:18 


PROBABILITY: 


0.05 


STATE: 


L 


OCCURRENCE 
TIMES: 


00:10:03 


PROBABILITY: 


0.02 


STATE: 


M 


OCCURRENCE 
TIMES: 


00:07:53 


PROBABILITY: 


r\ Art 

0.02 
























. . . 














STATE: 


V 


OCCURRENCE 
TIMES: 


00:13:31; 
00:15:37 


PROBABILITY: 


0.01 


OBJECT R 


EFERENCES: 


A1 


A3 


A456 


A358 


A2 


A47 


A13256 


A5432 


A67834 


A89045 


A56732 


A45098 


A43 


A33 


A5623 


A1234 


A5432 


A5678 


A47890 


A87 


















































A764 


A368 


A412 


A8345 


A21 


A54 


A43876 


A11 



FIG. 11 



Mingqiu 5 UN riiea. June zt, zuuj 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 12 Page 12 of 17 




Mingqiu oun 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 13A Page 13 of 17 



128 



331 



132 



( Enter ) 



COLLECT SET OF 
ENTRIES FROM TRACE 



WEIGHT ENTRIES 




r 


CREATE POSSIBLE 
STATE SIGNATURE 


} 


f 



FIRST POSSIBLE STATE 
SIGNATURE? 



YES 



120 



122 



124 



126 
NO 



1 



CURRENT STATE SIGNATURE = 
POSSIBLE STATE SIGNATURE 




130 



CREATE STATE DATA 
STRUCTURE 



STORE MEMORY PROFILE 



DROP OLDEST ENTR(IES), 
ADD NEW ENTR(IES) 



B 



FIG. 13A 



MingqiuSUN niro. JU n»*,,«. 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 13B Page 14 of 17 




134 



CALCULATE DIFFERENCE BETWEEN CURRENT 
STATE SIGNATURE AND CURRENT POSSIBLE 
STATE SIGNATURE 



I 



SIGNATURE DIFFERENCE > 
THRESHOLD? 



YES 



CURRENT STATE SIGNATURE = 
POSSIBLE STATE SIGNATURE 




I 



IS CURRENT STATE 
SIGNATURE NEW? 



YES 






CREATE STATE DATA 
STRUCTURE 










STORE MEMORY 
PROFILE 






343 





UPDATE LAST STATE'S 
DATA STRUCTURE 






r 



144 



146 



SPACE CONSTRAINT? 



NO 



YES 



150 



DROP STALEST STATE 
DATA STRUCTURE 




B 



FIG. 13B 



MingqiuSUN Filed: June 27, 2003 

Attorney Docket: 20002/16136X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIGS. 13C Page 15 of 17 




UPDATE MEMORY 
PROFILE 



I 



UPDATE LAST STATE'S 
DATA STRUCTURE 



CALCULATE ENTROPY 
OF CURRENT STATE 



IDENTIFY NEXT 
PROBABLE STATE(S) 



EXECUTE 
PREFETCHING 
STRATEGY 



358 



160 



162 



164 



366 



168 



ENTROPY SPIKE IDENTIFIED? 



NO 





YES 








END OF LAST 






TRANSACTION 




► 





170 




B 



FIG. 13C 



ruca. June *.f, ^wj 
Serial No.: 



Mingqiu oiiiv 

Attorney Docket: 20002/16136X2 
"Methods and Apparatus to Prefetch Memory Objects" 
FIGS. 14, 15 Page 16 of 17 



/ START PRE-FETCHING \ 
V STRATEGY J 





f 


PREFETCH OBJECTS FOR MOST 
PROBABLE STATE(S) 




f 



380 



RETURN 



FIG. 14 



START PRE- 
FETCHING 
STRATEGY 



382 



386 



ENTROPY < X? 



YES 




ENTROPY > Y? 



YES 



384 



PREFETCH OBJECTS 
FOR MOST PROBABLE 
STATE(S) 



NO 



PREFETCH OBJECTS 
FOR ALL PROBABLE 
STATE(S) 



RETURN 



388 



FIG. 15 



ivnngqiu oUIN rnea. June tr, 

Attorney Docket: 20002/1 6 1 36X2 Serial No.: 

"Methods and Apparatus to Prefetch Memory Objects" 
FIG. 16 Page 17 of 17 



FIG. 16 



RANDOM ACCESS 
MEMORY 



1014 
4 



READ ONLY 
MEMORY 



1016 



1012 
1^ 



PROCESSOR 



1018 



INPUT 
DEVICE(S) 



I 



OUTPUT 
DEVICE(S) 



MASS 
STORAGE 
DEVICE 



1022 



1020 



INTERFACE 



1024 
V 



1028 
V 



